IWPT 2020 Shared Task Results of robertnlp/mainsubmission

Coarse F1 Scores

Each score pertains to the combined test set of the language, without distinguishing individual treebanks and the enhancement types they annotate. The last line shows the macro-average over languages.

LanguageTokensWordsSentencesUPOSXPOSUFeatsAllTagsLemmasUASLASCLASMLASBLEXEULASELAS
Arabic
Bulgarian
Czech
Dutch
English99.4899.4886.2295.750.0094.710.0095.6289.4386.8784.9876.6080.4889.3588.94
Estonian
Finnish
French
Italian
Latvian
Lithuanian
Polish
Russian
Slovak
Swedish
Tamil
Ukrainian
Average5.855.855.075.630.005.570.005.625.265.115.004.514.735.265.23

Qualitative F1 Scores

The system output for each language was split into parts corresponding to individual source treebanks. The scores then ignore errors in enhancement types for which the treebank lacks gold-standard annotation. The column LAvgELAS shows the qualitative ELAS averaged over treebanks of the same language; the final average in bold is averaged over languages rather than treebanks. For comparison, the last column then shows the coarse ELAS F1 for the given language.

TreebankTokensWordsSentencesUPOSXPOSUFeatsAllTagsLemmasUASLASCLASMLASBLEXEULASELASEnhancementsLAvgELAScf.
Arabic-PADT(no xsubj)0
Bulgarian-BTB0
Czech-FicTree0
Czech-CAC0.00
Czech-PDT0.00
Czech-PUD(no codepend)0.00
Dutch-Alpino0
Dutch-LassySmall0.00
English-EWT99.1599.1581.1895.450.0095.590.0096.7088.0685.6482.9977.3080.5588.4188.0689.0288.94
English-PUD99.8699.8696.2596.100.0093.660.0094.3491.0688.3387.4875.7280.4090.4489.9789.0288.94
Estonian-EDT(no xsubj)0
Estonian-EWT(no codepend, no xsubj)0.00
Finnish-TDT0
Finnish-PUD(no codepend, no xsubj)0.00
French-Sequoia(no gapping, relcl, case)0
French-FQB(no gapping, relcl, case)0.00
Italian-ISDT0
Latvian-LVTB0
Lithuanian-ALKSNIS0
Polish-LFG(no gapping)0
Polish-PDB0.00
Polish-PUD0.00
Russian-SynTagRus0
Slovak-SNK0
Swedish-Talbanken0
Swedish-PUD0.00
Tamil-TTB(no gapping, xsubj, relcl)0
Ukrainian-IU0
Average7.117.116.346.840.006.760.006.826.406.216.095.465.756.396.365.24